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The  electronic  delivery  of  technical  information  in  computer-based  job  performance 
aids  (JPAs)  for  maintenance  will  rely  heavily  on  graphic  displays  of  schematics,  printed 
circuit  (PC)  boards,  illustrated  parts  breakdowns  (IPBs),  and  locator  diagrams.  Optimal 
levels  of  critical  visual  display  parameters  such  as  screen  size  and  resolution  must  be 
identified  to  maximize  the  efficiency  and  effectiveness  of  task  performance  and  to 
determine  device  design  requirements.  The  purpose  of  this  experiment  was  to  determine 
locator  task  performance  varied  as  a  function  of  changes  in  display  screen  size  and 
resolution  when  information  needed  to  perform  a  task  is  presented  in  a  graphic  format. 
Graphic  displays  of  PC  boards  were  presented  on  a  cathode  ray  tube  (CRT)  under  varying 
conditions  of  screen  size  (5"x5",  9"x9",  and  12"xl2")  and  resolution  (35,  70,  140,  280 
per  inch).  Students  were  asked  to  locate  test  points  on  an  actual  PC  board,  based  on 
points  identified  by  a  flashing  arrow  on  a  graphic  display  of  the  PC  board. 
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The  results  demonstrated  that  screen  size  affected  response  accuracy  only  when 
the  graphic  display  contained  a  large  number  of  highly  similar,  densely  packed 
test  points  (i.e.,  there  was  low  descriminabil ity  among  the  test  points).  In 
this  case,  the  largest  screen  size  produced  the  highest  accuracy  rates.  Screen 
size  did  not  affect  response  accuracy  when  the  test  points  on  the  graphic  display 
were  of  many  different  shapes  and  sizes  (i.e.,  there  was  high  discriminabil ity 
among  the  test  points).  The  findings  also  revealed  that  resolution  had  no 
affect  on  response  accuracy.  In  terms  of  response  time,  the  data  suggested  that 
screen  size  did  not  affect  the  time  needed  to  perform  the  task.  Finally, 
although  response  time  differences  between  resolution  levels  reached  statistical 
significance  in  some  instances,  this  finding  has  little  practical  significance 
when  examined  in  the  context  of  overall  maintenance  task  performance. 
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PREFACE 

This  is  the  sixth  in  a  series  of  cooperative  research  efforts  that  began 
in  1978  between  the  Naval  Training  Equipment  Center  and  the  Air  Force  Human 
Resources  Laboratory.  The  present  study  was  carried  out  at  Lowry  Air  Force 
Base,  Colorado,  during  the  summer  of  1983.  Unlike  previous  research  performed 
under  the  Cooperative  Study  Series  which  focused  on  flight  training,  the 
present  study  examines  issues  related  to  the  use  of  automated  job  performance 
aids  (JPAs)  for  maintenance. 

Both  the  Naval  Training  Equipment  Center  and  the  Air  Force  Human 
Resources  Laboratory  are  engaged  in  research  aimed  at  developing  automated 
JPAs  for  maintenance.  Although  the  two  research  programs  differ  in  many 
respects,  there  are,  nonetheless,  several  shared  research  issues  which  must  be 
resolved  before  the  systems  can  be  fielded.  The  issues  addressed  in  this 
study  concern  the  presentation  of  technical  information  via  electronic 
delivery  media.  The  study  examines  how  changes  in  display  screen  size  and 
level  of  resolution  impact  maintenance  task  performance  when  technical 
information  is  presented  on  a  CRT. 

Both  commands  shared  in  performing  this  research.  The  Naval  Training 
Equipment  Center  developed  the  research  design,  prepared  the  experimental 
materials  in  a  hardcopy  format,  analyzed  the  data,  and  prepared  the  technical 
report.  The  Air  Force  Human  Resources  Laboratory  provided  the  computer 
hardware,  developed  the  software,  provided  the  testbed  equipment,  converted 
the  hardcopy  experimental  materials  to  an  electronic  format,  coordinated  and 
carried  out  the  data  collection,  provided  financial  support,  and  reviewed  the 
technical  report. 

Several  individuals  made  significant  contributions  to  this  research. 

Mr.  Donald  Thomas  of  the  Air  Force  Human  Resources  Laboratory  (Wright 
Patterson  Air  Force  Base),  1st  Lt  Bradley  J.  Poulliot  of  the  Air  Force  Human 
Resources  Laboratory  (Lowry  Air  Force  Base),  and  Mr,  Erich  Pearson  of  the 
Denver  Research  Institute  provided  the  technical  expertise  required  to 
accomplish  the  research. 

Thirty-six  enlisted  Air  Force  students  from  the  3453rd  Student  Squadron 
at  the  Lowry  Technical  Training  Center  served  as  subjects  in  this  experiment. 
They  are  to  be  commended  for  their  participation  and  cooperation  during  the 
study.  The  students  were  made  available  through  the  efforts  of 
SSgt  David  Mann,  the  Student  Training  Advisor,  and  SSgt  Kevin  Robinson,  both 
of  the  3405th  Student  Squadron  at  Lowry  Technical  Training  Center.  Their 
assistance  is  greatly  appreciated. 

Also,  a  special  thank-you  goes  to  those  individuals  who  reviewed  early 
drafts  of  this  report  and  provided  valuable  comments.  They  include  Dr. 

Eduardo  Salas,  Dr.  James  Driskell,  Dr.  Riciiard  Reynolds,  Dr.  Arthur  Blaiwes, 
Dr.  Dee  Andrews,  Dr.  Charles  Beagles,  and  Mr.  Dennis  Weller,  of  the  Naval 
Training  Equipment  Center's  Human  Factors  Division.  Finally,  my  sincere 
appreciation  goes  to  Ms.  Wanda  Allard  for  her  many  hours  of  work  involved  in 
the  preparation  and  production  of  this  report. 
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SECTION  I 
INTRODUCTION 


BACKGROUND 

The  Naval  Training  Equipment  Center  (NAVTRAEQUIPCEN)  and  the  Air  Force 
Human  Resources  Laboratory  (AFHRL)  are  developing  automated  job  performance 
aids  (JPAs)  for  maintenance.  The  purpose  of  the  NAVTRAEQUIPCEN  program  is  to 
develop  a  prototype  Personal  Electronic  Aid  for  Maintenance  (PEAM)  which  is  a 
small,  lightweight,  portable  JPA  that  can  be  transported  by  maintenance 
personnel  to  the  job  site.  The  system  is  intended  to  be  used  for  the 
presentation  of  technical  information  in  support  of  organizational  (0)  level 
maintenance  of  Navy  weapon  systems.  The  AFHRL  program  (Automated  Technical 
Data  Requirements  Design  Study)  is  directed  toward  the  development  of  a 
prototype  technical  data  presentation  system  for  intermediate  (I)  level 
maintenance  of  Air  Force  weapon  systems  with  subsequent  follow-on  applications 
for  0  level  maintenance. 

The  two  programs  differ  in  terms  of  the  type  and  scope  of  the  technical 
data  to  be  presented,  the  environmental  conditions  under  which  the  systems 
must  operate,  and  the  constraints  (e.g.,  size,  memory,  durability)  placed  on 
the  systems.  The  programs  overlap,  however,  in  that  both  involve  the 
presentation  of  technical  information  via  an  electronic  display  medium. 

The  use  of  electronic  delivery  media  for  job  performance  aiding  requires 
a  careful  consideration  of  the  design  variables  associated  with  the 
presentation  of  technical  information.  Poor  design,  inaccurately  specified 
visual  display  parameters,  and/or  omission  of  critical  design  features  can 
hinder  legibility  and  may  result  in  a  JPA  device  which  is  not  used  or  which 
may  prove  to  be  ineffective  in  providing  troubleshooting  assistance. 

Many  design  features  can  potentially  impact  the  legibility  of  technical 
information  presented  on  electronic  delivery  media.  Consequently,  it  becomes 
critical  to  derive  research-based  standards  to  determine  the  delivery  media 
requirements,  and  ultimately  JPA  device  design.  Past  research  has  focused 
primarily  on  character  attributes  (alphanumerics)  and  has  provided  design 
guidance  on  variables  such  as  optimum  symbol  size,  character  fonts,  luminance 
levels,  contrast  ratios,  etc.  (See  Appendix  A  for  a  summary  of  this  past 
research  and  Meister  (1984)  for  a  complete  review).  However,  there  has  been  a 
lack  of  research  on  the  legibility  of  graphic  displays,  particularly  line 
drawings,  presented  via  electronic  del ivery  media  (Swezey  and  Davis,  1983). 
Since  automated  technical  data  will  make  extensive  use  of  graphics  (e.g.,  PC 
boards,  schematics,  locator  diagrams,  IPBs),  the  legibility  of  the  stimulus 
materials  must  be  optimized  in  order  to  promote  efficient  and  effective 
maintenance  task  performance. 
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PRESENT  STUDY 

The  present  study,  the  first  in  a  more  protracted  research  program  on  tin 
legibility  of  graphics  in  JPAs,  was  designed  to  assess  the  effect  of  alternate 
display  (CRT)  screen  sizes  and  resolution  levels  on  user  ability  to  identify 
and  locate  PC  board  test  points.  Screen  size  was  examined  because  of  its 
direct  impact  on  device  portability,  a  primary  design  consideration.  Smaller 
displays  not  only  promote  portability,  but  are  also  less  expensive  than  larger 
ones.  However,  the  impact  of  small  screen  graphics  on  legibility  is  unclear. 
The  presentation  of  high  density  (complex)  graphics  on  small  screen  sizes 
tends  to  produce  a  "cluttered"  display  which  may  interfere  with  the  ability  to 
accurately  perceive  and  discriminate  between  components  of  the  graphic  (Swezey 
and  Davis,  1983).  Therefore,  it  is  important  to  determine  the  effect  of 
screen  size  on  legibility  of  graphics. 

The  second  variable  examined  was  display  resolution.  Despite  Gould's 
(1968)  recommendation  of  50  scan  lines  (i.e.,  picture  elements  or  "pixels") 
per  inch  for  graphics,  high  resolution  is  often  assumed  to  be  warranted 
because  of  the  greater  display  clarity  and  the  intuitive  belief  that  higher 
resolution  (automatically)  improves  legibility.  Because  of  the  lower  costs 
associated  with  low  resolution  graphics  production  and  the  impact  of 
resolution  on  display  monitor  requirements,  it  is  important  to  determine  if 
low  resolution  graphics  impact  legibility.  It  is  also  important  to  determine 
if  higher  resolution  can  provide  enough  clarity  to  "compensate"  for  small 
screen  clutter  when  complex  graphics  are  displayed. 

The  present  study  examined  three  CRT  screen  sizes  (5"x5",  9"x9",  and 
12"xl2")  and  four  levels  of  resolution  (35,  70,  140,  and  280  dots  (i.e., 
pixels)  per  inch)  and  assessed  the  impact  of  changes  in  these  variables  on 
locator  task  performance.  The  three  screen  sizes  and  the  four  resolution 
levels  were  selected  because  of  their  representativeness  of  the  range  of 
display  screens  commercially  available.  The  task  involved  locating  test 
points  (i.e.,  components  and  solder  connections)  on  two  actual  PC  boards  (one 
component  side  and  one  pin  side)  based  on  test  points  identified  in  a  graphic 
display.  It  was  hypothesized  that  performance  would  not  be  differentially 
affected  by  screen  size  or  by  resolution  level  for  either  the  component  side 
or  pin  side  PC  board  displays. 


2 


NAVTRAEQUIPCEN  IH'355/AFHRL-TR-84-55 


SECTION  II 
METHOD 

SAMPLE 

Thirty-six  Air  Force  maintenance  training  pipeline  students  (35  male  and 
1  female)  served  as  participants  in  the  study.  All  students  were  enrolled  in 
the  Precision  Measurement  Electronics  Speciality  course  (Number  3ADR324XD)  at 
the  Lowry  Technical  Training  Center,  Lowry  Air  Force  Base,  CO.  The  students 
ranged  in  age  from  18  to  26  years  with  a  mean  age  of  20.6  years.  Length  of 
time  in  Air  Force  service  for  the  students  ranged  from  7  weeks  to  10  months 
with  a  mean  length  of  time  in  service  of  4.1  months.  Seventeen  of  the 
students  wore  glasses  (or  contact  lenses),  19  did  not.  Visual  acuity  was  not 
assessed.  All  students  were  first  term  enlistees  attending  their  first  Air 
Force  technical  school.  Of  the  36  students,  three  indicated  that  they  had 
received  some  high  school  electronics  training  and  one  indicated  that  he 
attended  a  five-month  communications  electronics  course  at  a  private  technical 
school.  For  the  remaining  students,  the  Precision  Measurement  Electronics 
Speciality  course  constituted  their  only  electronics  training. 

APPARATUS 

The  Megatek  7210  high  resolution  vector  graphics  system  driven  by  the 
Digital  Equipment  Corporation  (DEC)  POP  11/34  mini-computer  (Megatek/PDP )  was 
the  system  used  for  presentation  of  the  stimulus  materials  to  the  students. 
The  Megatek/PDP  graphics  system  was  a  configuration  established  specifically 
for  this  study  and  consisted  of  the  following;  (1)  a  Megatek  vector-type 
graphics  display,  (2)  a  Megatek  graphics  processor  and  associated  peripherals, 
(3)  a  Digi-Pad  5  graphics  digitizer,  (4)  a  POP  11/34  processor  and  associated 
peripherals,  and  (5)  a  DEC  VTIOO  terminal  for  keyboard  input. 

The  Control  Data  Corporation  (CDC)  CYBER  73-16  mainframe  computer  was 
also  used  in  support  of  this  study.  In  order  to  take  advantage  o^  the 
graphics  development  tools  available  on  the  CYBER  73-16  system,  an  emulation 
program  written  in  FORTRAN  on  the  POP  11/34  was  developed  to  interface  the 
Megatek/PDP  graphics  system  with  the  CYBER  73-16.  The  emulation  program  was 
designed  to  make  the  Megatek/PDP  graphics  system  function  as  a  Chromatics  CG 
Series  graphics  terminal  for  which  the  CYBER  73-16  has  support  facilities. 
The  emulation  program  was  also  designed  to  simulate  the  three  display  screen 
sizes  and  the  four  levels  of  resolution. 

Two  actual  PC  boards  (the  transmitter  and  the  synthesizer  boards)  from 
the  AN/ARC-164  UHF  Radio  were  also  used  in  the  study.  The  sizes  of  the  actual 
PC  boards  and  tne  graphic  PC  boards  a'"e  presented  in  Table  1. 
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TABLE  1 

-  PC  BOARD  DIMENSIONS 

IN  INCHES* 

Transmitter  Board 

Synthesizer  Board 

Actual  Board 

4.94x4.69 

4.50x4.00 

5x5"  Graphic 

4.75x4.38 

4.31x3.75 

9x9"  Graphic 

8.63x8.00 

7.81x6.75 

12x12"  Graphic 

11.63x10.75 

10.50x9.13 

*Subject  to  a  measurement  error  of  +/-  0.06  inches 


PROCEDURE 

The  transmitter  and  synthesizer  PC  boards  of  the  AN/ARC-164  UHF  Radio 
were  selected  for  study  because  of  their  representativeness  of  the  types  of  PC 
boards  typically  encountered  in  maintenance  tasks.  The  component  (piece-part) 
side  of  the  transmitter  board  (Figure  1)  and  the  pin  (solder  run)  side  of  the 
synthesizer  board  (Figure  2)  were  used  in  this  study. 

Line  drawings  (paper  and  pencil)  were  generated  for  each  of  the  two  I’C 
boards.  The  drawings  contained  all  of  the  detail  of  the  actual  PC  boards. 
Graphic  line  drawings  of  the  two  boards  were  then  digitized  manually  using  the 
Digi-Pad  5  graphics  digitizer  for  graphic  display  on  the  Megatek  7210  high 
resolution  monitor.  The  result  was  a  graphic  display  of  the  component  side  of 
the  transmitter  PC  board  and  a  graphic  display  of  the  pin  side  of  the 
synthesizer  PC  board. 

Forty  components  on  the  transmitter  board  and  20  pins  on  the  synthesiser 
board  were  selected  as  test  points  for  use  in  the  locator  task.  The  10 
components  on  the  transmitter  board  were  divided  into  10  groups  with  eacfi 
group  composed  of  four  similar  components  matched  on  size,  shape,  and 
proximity  to  key  features  (i.e.,  each  of  the  four  components  making  up  a  group 
were  all  the  same  size,  shape,  and  type  of  component  and  were  all  located  in 
the  same  general  area  of  the  board).  The  20  pins  on  the  synthesizer  bou-'d 
were  divided  into  five  groups  with  each  group  composed  of  four  pins  matched  on 
location.  Each  of  the  four  components/p i ns  within  each  group  were  then 
assigned  to  different  resolution  levels.  The  matching  was  done  in  order  to 
reduce  the  variability  between  the  test  points  to-be-located  in  the  different 
resolution  levels. 

A  software  program  written  in  CAMIL  (Computer  Assisted/Managed 
Instructional  Language)  was  developed  for  presentation  of  text  and  graphics  to 
the  students.  The  software  presented  instructional  text  to  the  students, 
displayed  the  graphic  line  drawings,  displayed  a  flashing  arrow  at  the  test 
point  to-be-located  by  the  student,  and  recorded  student  performance  data 
gathered  during  the  experiment.  A  second  software  program,  written  in 
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igure  1.  Transmitter  PC  Board  of  the  AN/ARC-164 
UHF  Radio  (component  side). 


Figure  2.  Synthesizer  PC  Board  of  the  AN/ARC-164 
UHF  Radio  (pin  side) . 
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RTRAN,  was  developed  in  order  to  simulate  the  three  display 
(irougti  electronic  masking  of  a  larger  display  scr-een)  and  the 
'Solution. 


screen  sizes 
four  levels  of 


Tne  four  resolution  levels  were  simulated  via  a  software  control 
’chnique  which  involved  the  use  of  a  coordinate  checking  and  validation 
'ocess.  Through  this  process,  specific  pixels  (dots)  were  selectively  turned 
1  (stimulated)  or  turned  off.  In  the  ^^80  dots  per  inch  condition,  all  pixels 
lich  composed  the  line  drawing  were  stimulated;  in  the  140  dots  per  inch 
jndition,  one-half  of  the  pixels  were  stimulated  (i.e.,  every  other  pixel  was 
jrned  on);  in  the  70  dots  per  inch  condition,  one-fourth  of  the  pixels  were 
timulated  (i.e.,  4  pixels  were  turned  off  between  each  stimulated  pixel); 
id  in  the  35  dots  per  inch  condition,  one-eighth  of  the  pixels  were 
timulated  (i.e.,  8  pixels  were  turned  off  between  each  stimulated  pixel). 
ie  stimulated/unstimulated  pixel  array  for  each  resolution  level  is  depicted 
n  Figure  3. 
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Figure  3.  Array  of  Stimulated  Pixels  By  Resolution  Level 

The  36  students  were  randomly  assigned  a  student  number  which 
orresponded  to  one  of  the  three  display  screen  sizes.  On  this  basis,  1? 
tudents  were  assigned  to  the  5''x5"  screen  size  condition,  12  students  to  the 
"x9"  screen  size  condition,  and  12  students  to  the  12"xl2"  screen  size 
ondition.  Each  student  was  tested  individually. 

Students  were  seated  approximately  28"  from  the  display  screen  with  no 
estrictions  placed  on  posture.  Each  student  received  general  instructions 
erbally  from  the  experimenter  (see  Appendix  B).  Detailed  instructions  were 
hen  presented  on  the  display  screen  (see  Appendix  C).  Prior  to  the  actual 
orator  task  trials,  each  student  performed  practice  trials  to  a  criterion  of 
hree  consecutive  correctly  identified  test  points.  The  practice  trials  used 
est  points  which  were  different  than  those  used  in  the  actual  data  collection 
'base  and  were  administered  at  the  resolution  level  in  which  the  student  would 
egin  the  actual  trials.  Thirty-four  of  the  students  achieved  the  criterion 
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c.  Alternative  display  media  -  In  the  future,  electronic  JPAs  may 
be  expected  to  be  used  in  field  applications  (outdoors).  Electronic  deliver-y 
media  may  make  use  of  different  display  technologies  (e.g.,  light  emitting 
diodes  (LED),  electroluminescent  panels,  plasma  panels,  liquid  crystal,  etc.). 
These  media  may  be  better  suited  for  displaying  technical  information  under 
certain  environmental  conditions.  Also,  critical  legibility  factors  should  be 
examined  across  types  of  display  media  to  determine  the  impact  on  task 
performance  in  various  environments. 

d.  JPA  devices  for  training  -  The  potential  application  of  JPA 
devices  to  serve  a  training  function  (in  addition  to  the  aiding  function)  has 
been  largely  untapped.  The  utility  of  JPA  devices  to  meet  training  needs 
should  be  determined  through  systematic  investigation. 
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SECTION  V 
CONCLUSIONS 


The  intent  of  this  research  was  to  provide  design  guidance  in  support  ol 
automated  JPA  development.  Although  the  research  was  tailored  specifically  to 
JPA  design  issues  related  to  maintenance  functions,  the  results  may  apply  to 
other  situations  in  which  CRT-based  graphics  are  used.  Based  upon  the 
findings,  the  following  conclusions  are  drawn: 

1.  The  5"x5"  display  should  not  be  used  for  graphics  with  high 
information  density  and  low  discriminabi 1 ity  among  elements  within  the 
graphic.  This  size  should  suffice,  however,  for  displays  with  high 
discriminabi lity  among  the  elements. 

2.  Since  the  9"x9"  and  12"xl2"  display  sizes  resulted  in  statistically 
equal  response  accuracies  for  both  the  pin  side  and  component  side  graphics, 
either  size  can  be  used  to  produce  best  overall  accuracy.  Final  size 
selection  should  be  based  on  other  factors  (e.g.,  cost,  portability,  device 
size,  etc.). 

3.  Display  size  had  no  significant  impact  on  the  amount  of  time  required 
to  perform  the  locator  task. 

4.  Level  of  resolution  had  no  practical  impact  on  either  response 
accuracy  or  response  time.  Design  decisions  pertaining  to  the  resolution 
required  should,  therefore,  be  based  on  factors  other  than  accuracy  rates  and 
response  times  (e.g.,  monitor  requirements). 

5.  Further  research  is  warranted  in  order  to  identify  optimum  visual 
display  parameters  for  electronic  JPAs.  Suggested  research  areas  include: 

a.  Level  of  detail  -  When  portability  and  size  are  critical  design 
issues,  smaller  displays  may  be  required,  yet  the  data  suggest  that  the  5’‘x5" 
display  may  hinder  response  accuracy  for  graphic  displays  with  high 
information  density  and  low  discriminabi 1 i ty.  Information  density  can  be 
reduced  and  di scriiii inabi  1  i ty  enhanced  by  varying  the  amount  of  detail  in  tiie 
graphic  line  drawings  (i.e.,  by  eliminating  non-critical  segments  of  the 
grapinc  display).  The  impact  of  varying  the  amount  of  detail  is  unknown. 

b.  Effect  on  overall  maintenance  task  performance  -  The  study 
focused  on  one  small  step  of  the  entire  maintenance  process:  locating  PC 
board  test  points.  Additional  research  should  focus  on  tasks  more 
representative  of  the  domain  in  which  automated  JPAs  will  be  used;  fault 
isolation,  remove  and  replace,  disassembly/assembly,  etc.  The  results  of  such 
analyses  would  provide  stronger  evidence  of  the  impact  of  critical  legibility 
variables  on  overall  maintenance  task  performance  when  electronic  display 
media  are  used. 
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errors  are  infrequent,  emphasis  is  placed  on  speed,  and  each  task  is  completed 
in  a  matter  of  seconds.  In  this  case,  a  one  second  difference  in  search  and 
retrieval  time  would  represent  a  significant  proportion  of  total  task  time. 

An  extra  one  second  in  search  and  retrieval  time  when  JPAs  are  used  to 
assist  in  maintenance  task  performance  does  not  appear  to  have  the  same 
implications  as  those  described  by  Tullis  (1983).  Maintaining  complex 
equipment,  unlike  the  tasks  in  a  highly  procedural! zed  production  setting,  is 
typically  not  highly  structured,  repetitive,  or  procedural ized,  even  when  JPAs 
are  used.  The  primary  emphasis  in  maintenance  is  on  accuracy,  that  is, 
returning  the  equipment  to  a  fully  operational  condition.  Often,  the  entire 
maintenance  task  requires  several  hours  to  complete. 

When  performing  maintenance  tasks,  technicians  must  search  for  and 
retrieve  technical  information  (from  either  paper  media  such  as  technical 
manuals  or  paper  JPAs,  microfilm/microfiche,  or  electronic  display  media)  in 
order  to  make  the  repair.  Typically,  the  time  required  to  locate  the  critical 
information  is  quite  short.  (In  the  present  study,  the  overall  mean  response 
time  was  5.76  seconds  for  the  component  side  and  6.09  seconds  for  the  pin 
side).  The  bulk  of  maintenance  task  time  is  usually  devoted  to  applying  the 
"retrieved"  information  to  the  piece  of  equipment  under  repair  and  to  actually 
making  the  repair.  In  other  words,  the  information  needed  (e.g.,  identifying 
the  test  points  to  be  probed)  can  be  obtained  rapidly,  but  implementing  that 
information  (actually  probing  the  test  points  and  determining  tolerance 
levels)  and  then  making  the  repair  (removing  the  faulty  module/component  and 
replacing  it)  account  for  the  majority  of  the  maintenance  task  time.  Thus, 
one  extra  second  of  search  and  retrieval  time  represents  a  very  small 
proportion  of  total  task  time. 

When  examined  in  the  broader  context  of  an  overall  maintenance  task  which 
may  require  several  hours  to  complete,  the  small  time  differences  which  were 
evident  across  resolution  levels  are  put  into  perspective.  Even  when  a  large 
number  of  test  points  must  be  identified,  the  cumulative  effect  of  such  time 
differences  is  still  relatively  small.  Therefore,  it  appears  that  the  impact 
of  a  one  second  time  reduction  in  locator  task  performance  is  negligable, 
despite  the  statistically  significant  differences. 
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Resolution 

Although  response  accuracy  on  the  pin  side  PC  board  graphic  improved 
slightly  or  remained  steady  as  resolution  increased,  none  of  the  differences 
were  statistically  significant.  Similarly,  response  accuracy  between 
resolution  levels  on  the  component  side  PC  board  failed  to  reach  statistical 
significance.  In  other  words,  for  both  PC  boards  examined,  response  accuracy 
in  the  lowest  resolution  level  (35  dots  per  inch)  was  not  significantly 
different  than  response  accuracy  in  the  highest  resolution  level  (280  dots  per 
inch).  This  finding  is  in  contrast  to  both  Gould  (1968),  in  which  50  dots  per 
inch  was  identified  as  the  minimum  resolution  for  graphics,  and  Stahin  (1980), 
who  suggests  that  70  dots  per  inch  should  be  the  minimum  resolution.  The  data 
suggest  that  for  tasks  such  as  locating  test  points  on  PC  boards,  level  of 
resolution  of  the  graphic  display  has  little  impact  on  response  accuracy. 

RESPONSE  TIME 

Screen  Size 

The  lack  of  significant  response  time  differences  between  screen  size 
conditions  for  both  PC  boards  suggests  that  screen  size  neither  helped  nor 
hindered  locator  task  response  time.  In  both  cases,  the  9"x9"  screen  resulted 
in  the  longest  response  times,  however,  the  times  were  statistically  equal  to 
those  in  both  the  5"x5"  and  12"xl2'‘  screen  size  conditions.  Thus,  the  results 
suggest  that  display  screen  size  is  not  critical  to  the  amount  of  time  needed 
to  locate  test  points. 

Resolution 

The  resolution  main  effect  for  the  component  side  graphic  demonstrated 
that  student  response  times  varied  significantly  across  resolution  levels; 
this  was  not  true  for  the  pin  side  graphic  where  response  times  were  equal  for 
all  resolution  levels.  Despite  the  statistically  significant  differences 
between  some  response  time  means,  the  differences  appear  to  have  little 
practical  significance  for  maintenance  JPAs.  An  examination  of  the  data  shows 
that  the  greatest  difference  between  the  response  time  means  was  .98  seconds 
for  the  component  side  (6.21  seconds  minus  5.23  seconds;  see  Table  D-5, 
Appendix  D).  In  other  words,  students  required  less  than  one  extra  second  (on 
the  average)  to  locate  components  in  the  280  dots  per  inch  condition  than  in 
the  140  dots  per  inch  condition. 

Tullis  (1983)  points  out  that  an  extra  one  second  in  search  and  retrieval 
time  on  each  CRT  frame  of  information  accessed,  translated  to  an  extra  55 
person-years  needed  for  extracting  such  information  (based  on  a  company-wide 
yearly  access  rate  of  344  million  CRT  frames  of  information).  Such  dramatic 
results,  however,  would  likely  be  applicable  primarily  in  settings  with  highly 
structured,  repetitive  jobs  where  tasks  are  highly  procedural ized  and  where 
most  of  the  total  task  time  is  devoted  to  searching  a  display  screen  for 
information.  In  this  type  of  setting,  tasks  are  relatively  easy  to  perform. 
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SECTION  IV 
DISCUSSION 


The  two  dependent  measures  used  in  this  study,  response  accuracy  and 
response  time,  are  discussed  below  in  terms  of  the  two  independent  variables 
examined,  screen  size  and  resolution. 

RESPONSE  ACCURACY 

Screen  Size 

Screen  size  had  an  affect  on  response  accuracy  only  when  discriminabi 1 ity 
between  test  points  was  low.  According  to  the  data,  graphic  displays  with 
large  numbers  of  highly  similar  test  points  located  in  proximity  to  one 
another,  such  as  in  the  case  of  the  pin  side  PC  board  graphic,  warrant  larger 
display  screens.  This  is  evidenced  by  the  significant  response  accuracy 
difference  between  the  5'‘x5"  and  12"xl2"  screen  sizes  on  the  pin  side  graphic, 
where  accuracy  was  almost  eight  percentage  points  higher  in  the  12"xl2" 
condition.  When  discriminability  between  test  points  is  high,  such  as  with 
the  component  side  PC  board  graphic,  accuracy  was  not  affected  by  screen  size. 
Based  on  these  findings,  it  appears  that  screen  size  is  critical  to  accuracy 
only  when  the  individual  elements  of  the  display  (i.e.,  test  points)  are 
highly  repetitious  and  densely  packed.  These  findings  may  be  explained  when 
one  examines  the  information  density  of  the  component  and  pin  side  graphic 
displays. 

The  component  side  graphic  contains  a  relatively  small  number  of  test 
points  dispersed  throughout  the  PC  board.  The  test  points  vary  widely  in  size 
and  shape,  and  because  of  this  diversity,  several  unique  landmarks  (cues)  are 
prevalent.  These  landmarks  may  serve  as  reference  points  which  aid  the 
student  in  "narrowing  the  search"  down  to  a  small  group  of  test  points  from 
which  final  identification  is  made.  Because  of  the  variety  of  shapes  and 
sizes,  there  is  little  competition  from  surrounding  components.  As  a  result, 
the  ability  to  discriminate  between  components  is  relatively  easy. 
Consequently,  locator  task  performance  is  stable  across  conditions  and 
accuracy  scores  fluctuate  only  slightly. 

In  contrast  to  the  component  side  graphic,  the  pin  side  graphic  is 
composed  of  a  large  number  of  highly  similar,  densely  packed  test  points. 
According  to  Galitz  (1.980),  high  information  densities  contribute  to 
"competition  among  screen  components  for  a  person's  attention"  (p.  108). 
This  high  level  of  information  density,  coupled  with  a  small  display  screen 
tends  to  "squeeze"  the  elements  of  the  display  together,  which  may  have 
hindered  searching  behavior.  However,  as  screen  size  increases,  compactness 
is  reduced,  the  picture  is  expanded,  and  because  the  display  is  easier  to 
scan,  searching  for  test  points  is  facilitated.  Similar  explanations  have 
been  offered  by  Jones  (1978)  for  alphanumeric  displays. 
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Component  Side  PC  Board 

The  lack  of  a  main  effect  for  screen  size  (means  -  5.66  seconds,  5.91 
seconds,  and  5.70  seconds),  (p^.05),  suggests  that  response  time  was  not, 
significantly  impacted  by  screen  size.  However,  the  analysis  did  reveal  a 
main  effect  for  resolution,  £(3,99)  =  6.91,  £<.01,  indicating  that  significant 
response  time  differences  existed  between  resolution  levels  (means  =  6.00 
seconds,  5.59  seconds,  5.23  seconds,  and  6.21  seconds).  Duncan's  multiple 
range  test  identified  statistically  significant  response  time  differences 
between  the  35  and  140  dots  per  inch  conditions,  between  the  70  and  280  dots 
per  inch  conditions,  and  between  the  140  and  280  dots  per  inch  conditions;  (£ 
.05  in  all  cases).  The  data  show  that  response  time  was  shortest  when  the 
graphic  display  was  presented  at  the  140  dots  per  inch  resolution  level  (5.23 
seconds)  and  longest  when  presented  at  the  280  dots  per  inch  resolution  level 
(6.21  seconds).  No  interaction  between  screen  size  and  resolution  was 
revealed,  (£>.05).  Table  D-5  (Appendix  0)  presents  the  means  and  standard 
deviations  for  the  component  side  response  time  data,  analyzed  by  screen  size 
and  resolution.  Table  D-6  (Appendix  0)  is  the  summary  table  for  the  ANOVA 
performed  on  these  data. 

Pin  Side  PC  Board 

No  main  effects  were  found  for  screen  size  (means  =  6.12  seconds,  6.30 
seconds,  and  5.35  seconds)  or  for  resolution  (means  =  6.38  seconds,  5.75 
seconds,  6.11  seconds,  and  6.11  seconds),  (£>.05)  suggesting  that  neither 
variable  significantly  impacted  response  time.  No  screen  size  by  resolution 
interaction  was  revealed  in  the  analysis,  (£>.05).  The  means  and  standard 
deviations  for  the  pin  side  response  time  data,  analyzed  by  screen  size  and 
resolution,  are  presented  in  Table  D-7  (Appendix  0).  Table  D-8  (Appendix  0) 
is  the  summary  table  for  the  ANOVA  performed  on  these  data. 
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SECTION  III 
RESULTS 


RESPONSE  ACCURACY 

The  number  of  test  points  correctly  identified  by  each  student  for  each 
condition  was  converted  to  a  percentage  correct  score  and  the  analyses  were 
performed  on  these  percentages. 

Component  Side  PC  Board 

The  ANOVA  revealed  no  main  effect  for  either  screen  size  (means  =  89.59^, 
93.75%,  and  90.42%)  or  resolution  (means  =  91.11%,  93.33%,  89.72%,  and 
90.83%),  (£>.05),  suggesting  that  response  accuracy  is  not  significantly 
impacted  by  either  variable.  No  interaction  between  screen  size  and 
resolution  was  evident  in  the  analysis,  (£  >.05).  The  means  and  standard 
deviations  for  the  component  side  response  accuracy  data,  analyzed  by  screen 
size  and  resolution,  are  presented  in  Table  D-1  (Appendix  0).  Table  0-2 
(Appendix  0)  is  the  summary  table  for  the  ANOVA  performed  on  these  data. 

Pin  Side  PC  Board 

The  analysis  of  the  response  accuracy  data  for  the  pin  side  PC  board 
revealed  a  main  effect  for  screen  size,  £(2,33)  =  5.41,  £•  .01,  indicating  that 
screen  size  significantly  affected  accuracy  rates  (means ’=  90.83%,  95.00%,  and 
98.75%).  Duncan's  multiple  range  test  identified  significant  response 
accuracy  differences  between  the  5"x5"  (90.83%)  and  12"xl2"  (98.75%)  screen 
size  conditions,  (£<.05).  Student  locator  task  performance  was  significantly 
more  accurate  when  the  stimulus  material  (i.e.,  the  graphic  synthesizer  board) 
was  presented  on  the  12"xl2"  display  screen  than  when  presented  on  the  5"x5" 
display  screen.  No  other  differences  between  screen  size  means  reached 
statistical  significance. 

No  main  effect  was  found  for  resolution  (means  =  92.22%,  95.00%,  95.00%, 
and  97.22%),  suggesting  that  resolution  did  not  have  a  significant  impact  on 
accuracy,  nor  was  a  screen  size  by  resolution  interaction  evident  in  the 
analysis,  (£>.05).  Table  0-3  (Appendix  0)  presents  the  means  and  standard 
deviations  for  the  pin  side  response  accuracy  data,  analyzed  by  screen  size 
and  resolution.  Table  0-4  (Appendix  D)  is  the  summary  table  for  the  aNOVA 
performed  on  these  data. 

RESPONSE  TIME 

The  number  of  seconds  taken  by  each  student  to  locate  each  test  point  was 
recorded  for  all  conditions.  These  data  were  then  converted  to  scores  which 
represented  each  student's  average  response  time  for  locating  test  points  in 
each  condition.  The  analyses  were  performed  on  these  (average)  response  time 
data. 
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variables  or  the  differences  between  the  PC  boards.  To  further  clarify  the 
results,  subsequent  analyses  were  performed  using  Duncan's  multiple  range  test 
(Brunning  and  Kintz,  1977)  for  pairwise  comparisons  among  the  means  of 
significant  effects. 
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in  three  or  four  practice  trials,  one  student  required  six  practice  trials, 
and  one  student  required  10  practice  trials. 

All  IE  students  in  each  group  then  completed  four  sets  of  15  locator  task 
trials,  one  set  for  each  level  of  resolution.  Each  set  of  trials  consisted  of 
first  locating  and  identifying  10  components  on  the  actual  transmitter  PC 
board  and  then  locating  and  identifying  5  pins  on  the  actual  synthesizer  PC 
board,  based  upon  the  component/pin  identified  by  the  flashing  arrow  on  the 
graphic  display.  Thus,  each  set  consisted  of  15  trials  (10  components  and  5 
pins)  and  each  student  performed  a  total  of  60  different  trials  across  the 
four  levels  of  resolution.  The  order  of  presentation  for  level  of  resolution 
was  counterbalanced  in  order  to  ensure  that  the  repeated  measures  were 
independent  and  to  control  for  learning  effects. 

Due  to  hardware  limitations  and  the  amount  of  detail  depicted  in  the 
graphic  line  drawings,  the  data  lists  which  were  used  to  generate  the  graphic 
displays  of  the  PC  boards  tended  to  overload  the  computer’s  refresh  rate. 
This  resulted  in  slow  drawing  times  of  the  graphic  PC  boards  (51  seconds  for 
the  transmitter  board  and  103  seconds  for  the  synthesizer  board),  and  a  slight 
flickering  of  the  CRT  display.  The  slow  drawing  times  which  occurred  each 
time  the  display  changed  from  one  PC  board  to  the  other  (i.e.,  four  times  for 
the  transmitter  board  and  four  times  for  the  synthesizer  board)  could  not  be 
averted  and  were  witnessed  by  all  students.  The  flickering  of  the  display, 
however,  was  reduced  substantially  by  darkening  the  room  and  permitting  each 
student  to  adjust  the  intensity  control  on  the  monitor,  A  dimly  lit  table 
lamp  was  used  at  the  experimental  station  so  that  student  and  instructor  could 
see  the  actual  PC  boards  used  in  the  locator  task.  Despite  these  aUerations, 
a  very  slight  flicker  remained.  Student  comments  related  to  the  flicker  were 
minimal , 

PERFORMANCE  MEASURES 

Response  accuracy  (correct/incorrect)  on  the  locator  task  was  assessed  by 
the  experimenter  and  manually  entered  into  the  computer  following  each  trial. 
The  experimenter  was  an  electrical  engineer,  knowledgeable  in  PC  board  layout 
and  design.  Response  time  (in  seconds)  was  recorded  by  the  computer  from  the 
time  the  test  point  to-be-located  was  identified  by  the  flashing  arrow  until 
the  student  said  "stop"  and  the  experimenter  typed  "s"  on  the  keyboard. 
Response  accuracy  and  response  time  data  were  stored  by  the  computer  on  disk 
for  subseque  ,t  analysis. 

DESIGN  AND  ANALYSIS 

The  experiment  employed  a  3x4  mixed  design  with  three  levels  of  sct'een 
size  as  the  between-subjccts  factor  and  four  levels  of  resolution  as  the 
repeated  or  wi thin-subjects  factor.  Separate  analyses  of  variance  (ANOVAs) 
were  performed  for  each  of  the  two  PC  boards  and  for  the  two  dependent 
variables,  response  accuracy  and  response  time.  The  four  separate  ANOVAs  were 
performed  because  this  method  is  the  most  efficacious  means  for  data 
interpretat ion  and  does  not  confound  the  results  of  the  two  dependent 
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TABLE  A-1.  Visual  Display  Parameters  for  Electronic 


fO  ,  r.  • 

o  o 

CO  OD 

.  #*  CT> 

r— ^  t-H 

<T»  cn  • 

r— 4  ‘f—  r— 

ra  rx3 
*'  i- 
C  O 
03  CU 

•  r-  •  ^ 

-O  O  r- 
<y  CO  r— 
CT>  <U 
a)  r-H  _Q 
4^  O. 

S-  ••'  £ 

fO  r—  03 

>  03  O 


i/) 

JD 

<U 

e  S- 

. 

r—  CT^ 

03  • 

LO  cr» 

4_>  4 

^  O)  CTi 

T— i  •" 

c/)  S- 

S- 

I  ^  .0) 

I—  r—  -C  • 

^  UJ  to  to  CD 
■)  CO 

.  .  +j  .  ^  cr> 

)  O)  CO  r-4 

•  cn  (D  cj^  ^ 
)  f— I  4->  t-H  M- 

:  >%  ^ 

\  ^  ^  ^ 


>,cTi  fo  un  n3  s- 

N  UD  5 

cri  ■*■>  cn  ^ 

Ct;  rH  o)  •— I  oi  oo 


4->  -  CU  • 

4_>  4-J  <tJ  «-H 

t/)  t/)  O  CO 
^  jd  cn 
V-  CD  ^ 

.  ^  Sw  O'k 

r-«  o  •' 

cn  tn 

cn  .  #»  .  •»  ,—1  •#— 

«— I  f— t~^ 

r>.  •*  »— 

•'  0>  cn  ^  T3 

>>  r— *  1—4  ^ 

03  03 

DC  •'-C 
OJ  4->  C/)  O 

03  r—  00 

CL*f-  »»'Cn 

S-  e  5^  00  r-l 

<D  <13  -c: 
c  c/3  o  cn 

4-3  f-H  • 

t — 

•  r"  r— t  to 

S-.  cO  r*^  . 

^  cn  cn  1— 

o  ^  <1J 


o3  S»  ^ 

^  M- 
•—  O'  a> 

f—  x:  c— 

CD  lO  c/3  4-> 

3i  cO  ^ 
o  cn  •'‘13 
x:  r-4  CO  ^ 

00 

•  ^  ^ 

I -  I— *  •»' 

IT)  03  O 

cn  s-  ''00 

r"H  03  ^ 

C_?  O  r-t 
-S  -O 

.  -D  '' 

I —  cn  ^  cn 

fO  tD  SI  'r- 

cn  03 

4->  f— 4  ©3  ^ 

03  O 

''  i- 

4-3  03  • 

o  <4-  -a  cn  o 
O  03  >>c^  ^ 

c:  cn  cn 

o 


03  • 

o  cn  co 

1— » 

cn  cn 


•4-  T3  CD 
CD  03  S- 

r—  03 

4- >  03  O 

5-  +-> 

3  S-  "U 
-C  03  C 
CO  :>  03 


“O  “O 
C  CD 
(/)  O)  to 

3  4->  03 

O  X  -O 
3  CD 
C  C 

•r-  -O  <D 
4->  f—  O) 

C  :3  -o 
O  O 
o  x:  c^ 
(/>  o3 
sz 


03  O 
-O  -P  S- 
03  -P  <T3 
-O  03  CD 
C  <—  </3 
03  CD 


O  03  P 
U  O  </3 
03  O 
i-  s-  G 
03 
CD  S 
i-  O  •' 
03  <—  03 
P 

03  C  O 

in  o  ^ 


P  03  »  X 

03  *0  CD  CD 
5  C  C  P 
O  CD  ••- 
O  r— 
to  Q- 
"O  CD  CD  O 
C  O  -C  P 
03  P  "P 

S-  •  3 
03  P  o  -c: 

a.  X 

CX  03  03  c 

ID  4->  ja  o 


3 

£  JD  P 
S-  3  CD 
O  S-  <>^  “O 
P  P  c  c 

(J  O  Z3 

-a  CD 

03  CD  p  CD 
7D  </)  'r-  CD 

•  r-  “O  to 

O  CD  c 

>  .£=  O  O 

03  p  a  p 

QJ  q_  cn  P 
JO  o  c  to 
•r-  03 
^  ^ 

, —  03  ^  to 
C3  p  ‘f—  03 
o  c  >  CD 
-C  03 

to  U  r-  to 
(O  *r~ 

s  ^  P  -_ 

3  -C  >-  S 


P 

03  • 

CX  to  CD 
to  >^*0 
to  c 
03  r—  =3 
-C  Q. 

P  to  P 

03 

P  "O  </• 

°  o  o 


POP 

O  -t-  ' 

f—  _C  to 
jD  P  ft3 
O  P 
03  C 
-c:  O  to 


''  O  to 

to  21 
to  to 

<V  03 

C  ♦  P 
P  “D 

P  C 

cn  to  o 

•f—  13  ‘r— 

p 

XI  P  03 

X)  P 

^  C  P 
C  05  •*“ 
•I-  P  P 

r—  C 

X  to  03 
P  X 
c-r? 

P  o 
O  p  ^ 

r—  O 

OOP 
p  p 
X  p 
•'  ‘r-  to 
f—  >  p 
03  X 

o  p 

•I—  to  03 
P  P  X 
03  P 
G  >  >^ 
3  P  03 

^  p  E 


to  f— 
r—  to 

03  X  •*- 
>  C 
0)  D  •— 
O  o 
P  P 
P  cnP 

03  C 

X  P  O 
cn  03  p 

•r-  X 

X  --•-p 

to 

X  C  03 

POP 

•r-  -r-  p 

2  P  c: 
03  O 

X  c  u 

03  -f- 
T?  g  03 
p  :5 


to  c 

•r-  P  O 
c:  ‘r- 
r— «  p  to 
..  .r-  13 
O  X  r— 

p  g  p 

(O  c 


X  “O 
^  .  p 

X  P 
X  cn  P 

p  -r-  p 

P  X  P 
p  p 
p  to  i.- 
P  X 


p 

o 

fO 

P 

cn  p 

> 

X  P 

•r~ 

p 

P 

X 

O 

03 

E 

3 

P  *P 

E 

1 —  fO 

•r— 

X  r— 

c 

to  3 

•r— 

P  P 

X  — 

E 

P  P 

P  P 

03 

P 

X 

05  X 

p 

• 

•r— 

£  '‘X 

=J  X  03 

E  CD  P 

X 

•^  P  T- 

p 

C  p  03 

to 

•r^»  P  Q- 
£  P  E 

p  -r- 

p 

p  V- 
X  X  to 

X 

P  •*- 

X 

to 

r— 

to  ‘r-  >>) 

:3 

•r-  P 

o 

• 

X 

X 

P 

X  -r-  r— 

to 

2 

•r-  S-  n3 

P 

S-  P  3 

t/> 

p 

40  p  cn 

p 

p 

03  E 

o 

P 

£  >*, 
P.  03 

X 

X 

p  r- 

X 

o 

X  cn  X 

c 

r"> 

LT)  P  to 

13 

03  -r- 

o 

p 

<C  ~o 

cr: 

o 

to 

p 

p 

p 

>> 

p 

p 

p 

■1— 

cx:  X 

p 

UJ 

h-  ^ 

p 

LU  O 

SI 

E 

cH  P 

o 

az  to 

p 

cT  03 

X 

X  P> 

o 

o 

N  P 

P 

X 

•r^ 

P 

to  P 

c 

ro 

0 

P 

03 

a: 

c 

X  03 
•r-  P 

P 

p 

0 

P 

P  03 

X 

cn 

to 

03 

to 

P  X 

03 

cn 

p 

03 

03  t.3 

X 

c: 

p 

P 

2: 

Ul 

»r“ 

c. 

4J1 

p 

P 

P 

P 

»r- 

p 

C 

P  P 

p 

03 

X 

d 

0 

0  Q- 

0 

X 

O 

o 

t-j 

0 

Q 

0 

cii — ' 

Q 

LO 

Font  of  Characters  Most  popular  fonts  (e.g.,  Lincol n/MITRE ,  NAMEL ,  Brown,  1953;  Ketchell  &  Jenny. 

Leroy)  are  acceptable.  Serifs,  slanted  letters,  1968;  Shurtleff,  1970;  Semple 

and  variable  stroke  widths  should  be  avoided.  et  al . ,  1971;  Vartebedian, 

(Note:  Most  recommendations  for  CRT  fonts  have  1971;  Vandervolk  et  al . ,  1975: 

been  based  on  extrapolation  from  non-CRT  research).  Riley  &  Barbato,  1978; 


C\J 

^  cr»  0) 


0^5  CTt  Os 


c 
<D 
C  SI 

•f—  2  ^ 


“O  +-> 
OJ  c 

rsj 

<u 

to  o 

in 

JD 

o  o 
o 

s-  u 

u_  o 

ra 

O  fO 

U.  1 

E 

sz 

CL  o 

o  o 

— ^lO 

to 

to  +J 

o  c 

>14- 

S- 

<3J 

x:  -r- 

o  o 

+J 

CO 

o. 

c 

c 

c 

di  OJ 

*r“ 

o 

.  ^ 

, — 

r-H 

o 

03 

*■ 

»• 

“O 

CO  • 

CO 

03 

CO 

c 

L. 

c 

C\J 

• 

CD 

03 

C_ 

fO 

0)  CO 

CD 

+-) 

O 

r~i 

c 

f-H 

o 

»— 

cu 

CD  r—  O 

i-H 

03 

CO  00 

OJ 

o 

(/> 

X 

fC 

•a  o  t-< 

CD  03 

E 

r* 

r-H 

- 

</i 

oO 

c 

»> 

S- 

«-H 

r-H 

CD 

CO 

o 

03 

Lf> 

fO  *' 

>> 

•r- 

S 

•r- 

CD 

c 

. 

OS 

X  u 

X 

X 

03 

i“H 

• 

X 

o 

r-H 

<u  o  s- 

Q. 

03 

4- 

■ 

•  f— 

S- 

03 

f—  00  0) 

S- 

C-J 

M- 

r— 

CO 

o 

CD 

ct  OS  x: 

3 

03 

03 

CD 

r—H 

« 

r— »  C/) 

•  f* 

r— 

•  r> 

•  r> 

1 - 

r-H 

.  r 

J— 

oO 

CD 

X> 

+-> 

CO 

CD 

fD 

*' 

03 

<XJ 

S- 

03 

X 

•' 

r-- 

:z. 

<+-  C+_  ^ 

CD 

3 

CD 

CD 

X 

X 

Cs 

r— 

+-> 

»+-  ct-  00 

S- 

^H 

X 

1— H 

i“H 

03 

X 

r-H 

o 

<u 

<D  0)  O 

O) 

LO 

r— 

03 

> 

r-H 

c 

»» 

03 

*• 

(/) 

n— 

*■ 

iL 

+->  +-> 

-X 

S- 

* 

X 

XJ 

S- 

s- 

X 

O' 

o 

S-  S- 

r— 

S- 

o 

CL 

r“ 

s- 

03 

S- 

03 

TU 

o 

3  3  • 

3 

03 

CO 

E 

3 

03 

r— ~ 

3 

p: 

c 

S- 

x:  x:  *“ 

03 

X 

CD 

03 

O 

X 

o 

X 

O 

•D 

o 

(X)  CO  ro 

Ll_ 

c>o 

r-H 

O 

o 

CO 

t/3 

C3 

1 

XT 

CD 

“O 

E 

O 

C 

03 

c 

S- 

>s 

•r~ 

,r— 

O. 

3 

03 

CO 

XT 

U 

O 

E 

X 

03 

to 

s- 

3 

c+- 

to  O 

Ol 

03 

CD 

E 

X 

CO 

O 

C  X3  to 

to 

r— 

rv 

CO 

c: 

03 

O  E  (L> 

03 

*o 

o 

•r— 

X 

03 

C 

+-> 

♦f-  >>i — 

+-> 

“O 

OJ 

03 

03 

E 

•n“ 

03 

c 

+->  CO  O 

c 

c 

s- 

X 

, — 

T~** 

03 

r— 

<D 

•«-  C 

03 

03 

S- 

o 

r— 

03 

O 

XJ  <+-  03 

O 

(J 

03 

s- 

03 

S- 

C  O 

S- 

_ _ _ 

c 

X 

• 

X 

cn 

O) 

O  CD 

OJ 

03 

o 

c 

S- 

. — 

CL 

.  o  +->  c 

o. 

CO 

s_ 

o 

0) 

03 

•r— 

• 

O 

C  -r- 

4-> 

CL  +-> 

u 

X 

r— 

Ll_ 

X 

X 

in 

cn  0)  s  o 

-f-' 

03 

X 

CL 

X 

E 

04 

cud) 

LO 

C 

a> 

c 

X 

03 

CO 

• 

o 

>s 

♦r-  S-  -1- 

s- 

t-' 

X 

•r“ 

•  1/) 

o 

to 

a> 

2  QJ  > 

o 

o 

03 

E 

5 

“O 

u  u 

E 

Xi 

Qj  a. 

4-> 

LO 

3 

E 

03 

-r- 

(D 

T3 

•r—  to 

CO 

/— * 

X 

X 

c 

03  X 

03 

“O 

>  LO  T- 

LD 

O 

03 

r— • 

t/> 

X 

03 

X 

03 

X 

r— 

r-H  X 

CM 

+-> 

3 

•r“ 

3 

X 

X  03 

X 

03 

o 

E  03 

r— > 

•r-5 

*' 

3: 

o  s- 

S- 

o 

3  O  1 

03 

03 

4-> 

"D 

c 

CD 

X3 

03 

x: 

e  4->  M- 

CO 

> 

c 

03 

o 

CD 

03 

C 

CO 

•1“ 

03 

X  S- 

3 

0) 

+->0  0  3 

t/)  Q.f— 4  O' 

f—  O  Q> 

O  CO  •  i- 

O  S-  fO  -o 

G  a>  to 

>,“0  <1>  CO  o 

CO  c  CO  O  O) 

o  o 


CO  S-  c 
•r-  0)  O  eX 
sz  E 
+->  cn  fo 

C  'r- 

o  nr  c  jr 
S  a>  cn 

O)  x: 


c 

-o 

03 

03 

to 

c 

1 — 

03 

CD 

>1— 

, — ». 

X 

r3 

i/» 

E 

o 

03 

03 

X 

c 

S- 

03 

u 

X 

03 

r3 

s- 

CO 

X 

r— 

-o 

u 

X 

>s 

CD 

to 

- 

03 

03 

03 

- 

■o 

cr 

03 

•  f— 

o 

c 

03 

u 

O 

CO 

03 

C 

03 

03 

TD 

X 

to 

c 

o> 

X 

r 

S- 

to 

03 

X 

to 

03 

•r— 

r— - 

*r- 

>s 

r— 

S- 

c 

X 

X 

03 

03 

CO 

i- 

03 

03 

■O 

03 

03 

X 

X 

X 

r— 

CO 

X 

c 

f— 

X 

u 

D 

03 

CD 

O 

E 

r— 

CD 

03 

X 

S- 

X 

to 

X 

S- 

to 

03 

to 

X 

•r— 

CD 

3 

C 

S-. 

CD 

13 

to 

■CJ 

03 

03 

03 

X 

TD 

03 

c 

X 

-o 

03 

O 

•r- 

u 

03 

tD 

•  1— 

03 

4. 

4-» 

X 

■o 

S- 

S- 

X 

03 

03 

03 

X 

•r“ 

X 

03 

E 

i- 

’r~ 

X 

03 

X 

i/) 

03 

X 

03 

O) 

03 

X 

"O 

U 

u 

CD 

03 

03 

X 

X 

X 

X 

03 

X 

3 

X 

03 

03 

03 

X 

c 

(.> 

X 

03 

03 

f— 

03 

’t— 

03 

c 

r3 

S- 

CD 

03 

03 

03 

N4 

u 

X 

U 

X 

X 

03 

03 

U 

03 

03 

X 

o 

X 

03 

X 

•  1— 

cr 

03 

•  r- 

S- 

X 

(/> 

•r— 

X 

o 

X 

X 

•o 

CD 

SZ 

C 

oo 

X 

</) 

X 

03 

2Z 

CO 

X 

1 - 

X 

}— 

r3 

CD 

•1— 

►“H 

UJ 

03 

Q 

oo 

c 

• 

03 

o 

CD 

(D  TJ 

C3 

•f— 

c 

>  03 

C 

X 

•f— 

X 

03 

1 — 

03  >-0 

C 

r— 

X 

•r— 

o 

o 

O  03 

to 

S-. 

d 

3 

03 

t3 

X  03 

X 

nc 

OO 

^  (0 

of  the  user.  Fatigue  may  be  partially  due  to  work  1981;  flouran 
station  layout. 


APPENDIX  B 

VERBAL  INSTRUCTIONS  TO  STUDENTS 
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Good  morning  (afternoon).  My  name  is  Erich  Pearson  and  I  will  be  the 
instructor  for  this  exercise.  You  have  been  selected  to  participate  in  a 
study  that  will  help  the  Air  Force  determine  the  best  way  to  show  maintenance 
information  on  a  computer  screen.  The  specific  instructions  will  be  presented 
to  you  on  the  computer  screen,  so  I  will  not  go  over  them  here.  The  entire 
exercise  should  take  about  an  hour  and  a  half.  Before  we  get  started,  you 
will  have  a  few  practice  trials  so  that  if  you  are  confused  and  have  any 
questions,  you  can  ask  them  during  practice.  So,  if  you're  ready,  we'll 
begin. 


APPENDIX  C 

STUDENT  INSTRUCTIONS  PRESENTED  ON  CRT 


FRAME  ONE: 


INSTRUCTIONS 

You  are  part  of  a  study  to  find  the  best  way  to  show  maintenance 
information  on  a  computer  screen.  In  front  of  you  is: 

1.  A  computer  screen 

2.  A  section  from  a  radio 

3.  A  pencil  to  use  as  a  pointer 

The  person  next  to  you  is  the  instructor  running  the  study.  Tell  hin.  when 
you  have  finished  reading. 


FRAME  TWO: 


The  computer  screen  will  show  you  a  drawing  of  a  section  of  a  radio. 
The  shapes  on  the  drawing  are  the  same  as  the  shapes  of  the  parts  on  the 
radio  section.  The  instructor  will  show  you  how  to  hold  the  section  of  the 
radio  so  that  the  parts  on  the  drawing  will  match  those  on  the  radio.  He 
will  then  show  you  how  to  find  one  of  the  parts.  Tell  him  when  you  have 
finished  reading. 


FRAME  THREE: 


You  will  be  allowed  to  practice  some  before  the  scoring  starts.  When 
you  tell  the  instructor  that  you  are  ready,  one  of  the  parts  on  the  drawing 
will  have  an  arrow  drawn  to  it.  You  must: 

1.  LOCATE  THE  PART  ON  THE  RADIO 

2.  POINT  TO  THE  PART  WITH  THE  POINTER  AND  SAY  'STOP' 

3.  KEEP  THE  POINTER  ON  THE  PART  UNTIL  THE  INSTRUCTOR  TELLS  YOU  THAT  YOU 
MAY  MOVE  IT 


FRAME  FOUR: 


You  will  be  scored  on  how  fast  you  find  the  parts  and  on  whether  you 
find  the  right  parts.  Work  fast  but  be  sure  you  find  the  right  part.  If 
you  have  any  questions,  please  ask  the  instructor  now. 
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FRAME  FIVE:  (Presented  after  the  first  ten  trials  in  each  set) 


The  instructor  will  now  give  you  another  section  of  the  radio.  The  new 
section  has  one  side  removed  to  show  a  board  covered  with  little  silver 
connections.  The  instructor  will  show  you  how  to  hold  it  so  that  it  matches 
the  drawing  on  the  screen  and  how  to  find  one  of  the  connections.  You  are  to 
point  to  the  connections  on  the  radio  section  just  as  you  did  the  radio 
parts.  Remember,  you  are  being  scored  on  speed  and  accuracy.  If  you  have 
any  questions,  please  ask  the  instructor  now.  Otherwise,  ask  your  instructor 
for  the  new  radio  board. 
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APPENDIX  D 

MEANS,  STANDARD  DEVIATIONS  AND  SUMMARY  TABLES 
FOR  RESPONSE  ACCURACY  AND  RESPONSE  TIME  DATA 


TABLE  D-1 

MEANS  AND  STANDARD  DEVIATIONS  FOR  RESPONSE  ACCURACY  DATA 
ANALYZED  BY  SCREEN  SIZE  AND  RESOLUTION 
(COMPONENT  SIDE) 


SCREEN  SIZE  RESOLUTION 


35 

70 

140 

280 

Row  Means® 
{n=12) 

5x5 

M 

89.17 

92.50 

86.67 

90.00 

89.59 

SO 

9.96 

6.22 

7.78 

7.39 

7.98 

9x9 

M 

94.17 

96.67 

91.67 

92.50 

93.75 

SD 

7.93 

4.92 

7.18 

11.38 

8.15 

12x12 

M 

90.00 

90.83 

90.83 

90.00 

90.42 

SD 

8.53 

5.15 

7.93 

12.06 

8.49 

Column 

Means ^  M 

91.11 

93.33 

89.72 

90.83 

(N=36) 

SD 

8.87 

5.86 

7.74 

10.25 

Note.  The  values 
^Average  of  the  4 
^Average  of  the  3 


represent  mean  percent  correct  scores, 
resolution  means, 
screen  size  means. 


9 


9 
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TABLE  0-2 

ANALYSIS  OF  VARIANCE  SUMMARY  TABLE  FOR  RESPONSE  ACCURACY  DATA 

(COMPONENT  SIDE) 


SOURCE 

df 

SS 

MS 

F 

Between  Subjects 

35 

4625.00 

Screen  Size 

2 

466.67 

233.33 

1.85 

Error 

33 

4158.33 

126.01 

Within  Subjects 

108 

5350.00 

Resolution 

3 

247.22 

82.41 

1.65 

Screen  Size  x  Resolution 

6 

144.44 

24.07 

0.48 

Error 

99 

4958.33 

50.08 

TABLE  D-3 

MEANS  AND  STANDARD  DEVIATIONS  FOR  RESPONSE  ACCURACY  DATA 
ANALYZED  BY  SCREEN  SIZE  AND  RESOLUTION 
(PIN  SIDE) 


SCREEN  SIZE  RESOLUTION 


35 

70 

140 

280 

a 

Row  Means 
(n=12) 

5x5 

M 

90.00 

88.33 

90.00 

95.00 

90.83 

SD 

23.35 

10.30 

15.95 

9.05 

15.41 

9x9 

M 

90.00 

96.67 

95.00 

98.33 

95.00 

SD 

13.48 

7.79 

9.05 

5.77 

9.68 

12x12 

M 

96.67 

100.00 

100.00 

98.33 

98.75 

SD 

7.79 

0.00 

0.00 

5.77 

4.89 

Column 

Means^  M 

92.22 

95.00 

95.00 

97.22 

(N=36) 

SD 

16.05 

8.78 

11.08 

7.01 

Note. 

The  values 

represent  mean 

percent  correct 

scores. 

^Average  of  the  4  resolution  means. 
*^Average  of  the  3  screen  size  means. 
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TABLE  0-4 

ANALYSIS  OF  VARIANCE  SUMMARY  TABLE  FOR  RESPONSE  ACCURACY  DATA 

(PIN  SIDE) 


SOURCE 

df 

SS 

MS 

F 

Between  Subjects 

35 

6097.22 

Screen  Size 

2 

1505.56 

752.78 

5.41* 

Error 

33 

4591.67 

139.14 

Within  Subjects 

108 

12,100.00 

Resolution 

3 

452.78 

150.93 

1.33 

Screen  Size  x  Resolution 

6 

405.56 

67.59 

0.60 

Error 

99 

11,241.67 

113.55 

► 

i 


TABLE  D-5 

MEANS  AND  STANDARD  DEVIATIONS  FOR  RESPONSE  TIME  DATA 
ANALYZED  BY  SCREEN  SIZE  AND  RESOLUTION 
(COMPONENT  SIDE) 


SCREEN 

SIZE 

RESOLUTION 

35 

70 

140 

280 

Row  Means^ 
(n=12) 

5x5 

M 

5.95 

5.43 

5.28 

5.99 

5.66 

SD 

1.46 

1.35 

0.95 

1.58 

1.35 

9x9 

M 

6.31 

5.37 

5.48 

6.47 

5.91 

SD 

2.59 

1.30 

1.26 

1.85 

1.84 

12x12 

M 

5.73 

5.97 

4.93 

6.17 

5.70 

SD 

1.32 

1.39 

0.95 

1.96 

1.48 

Column 

Means ^ 

M 

6.00 

5.59 

5.23 

6.21 

(N=36) 

SD 

1.84 

1.33 

1.06 

1.77 

Note.  The  values 
^Average  of  the  4 
^Average  of  the  3 


represent  mean  response  times  in  seconds, 
resolution  means, 
screen  size  means. 
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TABLE  D-6 

ANALYSIS  OF  VARIANCE  SUMMARY  TABLE  FOR  RESPONSE  TIME  DATA 

(COMPONENT  SIDE) 


SOURCE 

df 

SS 

MS 

F 

Between  Subjects 

35 

225.36 

Screen  Si2e 

2 

1.61 

0.80 

0.19 

Error  , 

33 

223.75 

6.78 

Within  Subjects 

108 

124.08 

Resolution 

3 

20.41 

6.80 

6.91* 

Screen  Size  x 

Resolution  6 

6.21 

1.03 

1.05 

Error 

99 

97.46 

0.98 

TABLE  D-7 

MEANS  AND  STANDARD  DEVIATIONS  FOR  RESPONSE  TIME  DATA 
ANALYZED  BY  SCREEN  SIZE  AND  RESOLUTION 
(PIN  SIDE) 


SCREEN  SIZE 


RESOLUTION 


TABLE  D-8 

ANALYSIS  OF  VARIANCE  SUMMARY  TABLE  FOR  RESPONSE  TIME  DATA 

(PIN  SIDE) 


SOURCE 

df 

SS 

MS 

F 

Between  Subjects 

35 

288.90 

Screen  Size 

2 

4.92 

2.46 

0.29 

Error 

33 

283.99 

8.61 

Within  Subjects 

108 

167.96 

Resolution 

3 

7.29 

2.43 

1.59 

Screen  Size  x  Resolution 

6 

8.96 

1.49 

0.97 

Error 

99 

151.71 

1.53 
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Office  of  the  Deputy  Under 
Secretary  of  Defense 
OUSDRE  (E&LS) 

(CAPT  P.  R.  Chatelier) 
Pentagon,  Room  3D129 
Washington,  DC  20301 

Chief  of  Naval  Operations 
OP-01 

Washington,  DC  20350 

Chief  of  Naval  Operations 
0P-01B7  (Dr.  R.  Carroll) 
Washington,  DC  20350 

Chief  of  Naval  Operations 
OR-112 

Washington,  DC  20350 

Chief  of  Naval  Operations 
OP-29 

Washington,  DC  20350 


Chief  of  Naval  Operations 
OP-39 

Washington,  DC  20350 

Chief  of  Naval  Operations 
OP-59 

Washington,  DC  20350 

Chief  of  Naval  Operations 
0P-987H  (Dr.  R.  6.  Smith) 
Washington,  DC  20350 

Office  of  Naval  Research 
Code  270 

800  North  Quincy  Street 
Arlington,  VA  22217 

Office  of  Naval  Research 
Coc  ’  422 

800  North  Quincy  Street 
Arlington,  VA  22217 

Office  of  Naval  Research 
Code  422TT  (Dr.  S.  Chipman) 

800  North  Quincy  Street 
Arlington,  VA  22217 

Office  of  Naval  Research 
ONT  0722  (Dr.  S.  Col  Iyer) 

800  North  Quincy  Street 
Arlington,  VA  22217 

Naval  Air  Systems  Command 
Code  5313X  (LCDR  T.  N.  Crosby) 
Washington,  DC  20361 

Naval  Air  Systems  Command 
Code  330J  (CDR  T.  Jones) 
Washington,  DC  20361 

Naval  Air  Systems  Command 
APC  205-0M  (CDR  J.  M.  Owens) 
Washington,  DC  20361 
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Naval  Training  Equipment 
Center  Liaison  Office 
Code  L02  (Mr.  B.  Williams) 

CNET  Headquarters 
Naval  Air  Station 
Pensacola,  FL  32508-5100 

Chief  of  Naval  Education 
and  Training 
Code  OOA  (Dr.  W.  Maloy) 

Naval  Air  Station 
Pensacola,  FL  32508-5100 

Chief  of  Naval  Education 
and  Training 

Code  N-2  (CAPT  J.  B.  LeBlanc) 
Naval  Air  Station 
Pensacola,  FL  32508-5100 

Chief  of  Naval  Education 
and  Training 

Code  N-211  (Dr.  D.  Davis) 

Naval  Air  Station 
Pensacola,  FL  32508-5100 

Chief  of  Naval  Education 
and  Training 

Code  N-213  (Dr.  T.  M.  Ansbro) 
Naval  Air  Station 
Pensacola,  FL  32508-5100 

Chief  of  Naval  Technical  Training 
Code  N-62 

Naval  Air  Station,  Memphis 
Millington,  TN  38054 

Commander 

Naval  Air  Development  Center 
Warminster,  PA  18974 


Army  Research  Institiitf^ 
PERl-n  (Ur.  R.  Seidrl) 

5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

Army  Research  Institute 
Systems  Manning  Tecitnical  Arr 
(Dr.  B.  Knerr) 

5001  Eisenhower  Avenue 
Alexandria,  VA  22233 

Army  Research  Institute 
Library 

5001  Eisenhower  Avenue 
Alexandria,  VA  22233 

Office  of  Project  Manager 
for  Training  Devices 
Attn;  AMCPM-TND-E 
(Dr.  R.  Hofer) 

Naval  Training  Center 
Orlando,  FL  32813-7100 

Office  of  Project  Manager 
for  Training  Devices 
Attn;  Army  Research 
Institute  Liaison 
(Or.  H.  Ozkaptan) 

Naval  Training  Center 
Orlando,  FL  32813-7100 


Army  Research  Institute 
TRl'  (Dr.  H.  O'Neil,  Jr.) 
5001  Eisenhower  Ayenue 
AlexanHria,  VA  22333 
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